Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tempo tuning section #830

Open
wants to merge 7 commits into
base: staging
Choose a base branch
from
Open

Conversation

josunect
Copy link
Contributor

@josunect josunect commented Oct 24, 2024

Ref. kiali/kiali#7769

https://deploy-preview-830--kiali.netlify.app/docs/configuration/p8s-jaeger-grafana/tracing/tempo/#tempo-tunning

  • The Grafana documentation has wide guidelines on to improve performance. Is this PR, just a summary of what you can change is added, pointing to the official Grafana docs.
  • Included table of contents

@josunect josunect added the enhancement New feature or request label Oct 24, 2024
@josunect josunect self-assigned this Oct 24, 2024
@josunect josunect changed the title Add tempo tunning section Add tempo tuning section Oct 24, 2024
@josunect josunect marked this pull request as ready for review November 13, 2024 14:07
Copy link
Contributor

@jshaughn jshaughn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good information, a few recommended edits.

#### Resources consumption

Grafana Tempo is a powerful tool, but it can lead to performance issues when not configured correctly.
The following configuration can lead to OOM issues for simple queries in the query-frontend component:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The following configuration can lead to OOM issues for simple queries in the query-frontend component:
For example, the following configuration is not recommended and may lead to OOM issues for simple queries in the query-frontend component:

```

These resources are shared between all the Tempo components.
Instead of applying the resources globally, they can be applied to each specific component, when needed:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Instead of applying the resources globally, they can be applied to each specific component, when needed:
When needed, apply resources to each specific component, instead of applying the resources globally:


#### Caching

Tempo can use [a cache](https://grafana.com/docs/tempo/latest/operations/caching/) that acts in different levels that is used by default with Tanka and Helm deployment examples. It uses external cache, supporting Memcached and Redis.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Tempo can use [a cache](https://grafana.com/docs/tempo/latest/operations/caching/) that acts in different levels that is used by default with Tanka and Helm deployment examples. It uses external cache, supporting Memcached and Redis.
Tempo offers multi-level [caching](https://grafana.com/docs/tempo/latest/operations/caching/) that is used by default with Tanka and Helm deployment examples. It uses external cache, supporting Memcached and Redis.


#### Dedicated attribute columns

When used the storage format vParquet3, defining [dedicated attribute columns](https://grafana.com/docs/tempo/latest/operations/dedicated_columns/) can improve the query performance.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
When used the storage format vParquet3, defining [dedicated attribute columns](https://grafana.com/docs/tempo/latest/operations/dedicated_columns/) can improve the query performance.
When using the vParquet3 storage format , defining [dedicated attribute columns](https://grafana.com/docs/tempo/latest/operations/dedicated_columns/) can improve the query performance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: 🏗 In progress
Development

Successfully merging this pull request may close these issues.

2 participants